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Abstract of JP6175817 

PURPOSE: To compensate the voice output of 
a multimedia system so as to effectively utilize 
all the effect of a multimedia program while 
allowing a user to easily distinguish a tone. 
CONSTITUTION: A system and method is 
used for detecting and compensating the 

hearing disorder of a testee. First, a heanng _ 

test generated by the multimedia system is *L**mm+a-*+* I 

qiven to the testee. Next, a voice frequency l^^v .rrtrtrJAteltf+ta fT^J 

which is outputted from a multimedia computer 1 
system and in which the testee heanng acuity a 
is recognized to be disabled through the use of 
the result of the hearing test is 
increased/reduced so as to property 
compensate it In the environment of a class 
room, the result of the hearing test can be 
used by the testee or a teacher. 
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B$3¥»*a>«H) 
t, 

* • 5^5Sk©SFffl7j€H£iET*7.7 L S>7 , £, 

[»**2] ^EftS;^./^, 
HJEa.— !f K4>fc< 1 ^© I — >*.&&r?2>*y-v 

tfjE4>fe< 1 1> 1 >*<)ftEa.— tftcffl w Aft t 

aSC<0h->«H^ fl(|E^<^*>l , P«>H->* t3 - 
-ifCBflJlAftt^W^-rs^fiU^t, WE«t» 

■»f • T^r^fcfP/fcl"**^^^** 1141 *** 
SS*«2fcE«©*i*. 

f&E^-if • yc77-fA'fcS^ViT. )«iE3>t:a- 

iiHEa.— ificfl&EtfciEB^FtiiflstBttts^Stfcfc 

>*Ui*J S«HET*ft»W5'X-7 L A. 

[IJMKH5) #Etfe£¥gH* 
tdEi-lf C^>fe< 1 1> 1 h->«:««^S*g! 
t. 

jflE^ft < h->^OTEJ-— if \ZWIZ. 
tWt*5t*. i&E:i-ifa>e.©A?J«:£ttift* 

K»»riac.Afct*©*au^TmE^)ft< 



«R<Dh->^ «jE'>*<tfe1^©h->*i3.-1f 
CKJftTBBCAfctS^JEtSSaW'^Vt. SUES 
Scot) I — >fc^^s*7-fevh«»tfrgtr, ffiKa. 
-if • yo^r-f Jl/*ffJ$T-6*Rt^#A'&cifc*W 

i0 SlEa.— if- , 7*o7r'f;HlS^»T. SW23>tra— 

me a— tf t WEtf is^^ma * 5 1" 

[11*818) MElBWft^BWt. 

MBa— if C^fc < & 1> 1 Odi V— >**ffi*Sn* £ 5 

SW^TftSit, fll}Ea-^&©A2l£'g#JftS 

*Ea— tf 6 5>A7J fcStflRS *T. fl[Ed>ft < £ *> 

»i;-fS. SSf*fl7l^E«©3>tfA-^ • 7*13*5 
A. 

fcDftrBBC Afct^f(DSSW^;i/T?*lE4>fe< 1 
30 i»Ei»& < 1 1> 1 -PO h->^flSEa— tf CtD»TWJ Z 

afT*. «*JR8KE«Oa>tra-^ • 7D^5 
A. 

40 [0001) 

ta- !f*«iE»tci«€»»T5n&vi h-^^SSSiJT*. 
a--!ffl3©*<0S67J7'a77-f;H-8^v>T^i/ 

J-*?*? • s^^f-A©ttl7J6tt«'f 5. 
(0 0 0 2) 
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'•£W£#l:J , *££:tf tv C$ft<i , 3:^ ®^ WjWtc&Z 
fc*?nxV>«>©XftV^#tK ■ V""W (® 

a) «-htfn& cKf.©w«sWiEra-i^^ 
S. UfctfoX. *£<©A#> #icAnxsj*f£*B« 

<©x. ws##&9mf?T**xe:&«&fc&tt#'& 

*>±ti\z%.m*i&^z ttf$<> *©*s#> #«©«*s 

[0 0 0 31 ffltt. «SU^;k*Wiia«T«< ^t€r 

*ifft>tis. £ns.©&a8K««fflux. mum** 

t0 0 0 4] fti^tf, ^B^WISSSOOS 1 l^fc 
.fctttB4 3 2 1 4 2 7 ^li. 18*1 B» «ff 5fc ft©£H 
&£tf;#i£*3B«UXU*. JKEttW^ 9 6 3 1 1 2 a? 

T*. #S»Sf3l4 7 6 8 1 6 5#tt. 

©v^ATfefc. #Hfc3fSM 4 8 9 6 1 0 

n*>^> ft**-*'?*)*)- t*»x- 

[0 00 5] 

<©5R&xte#anxv>*. #ssB«m*. 

ifctfXS.fc'S. Sfc. B»lt*?TV7b l )i7-i 

9x7 • a— if • yD7y<^SffiffltT. #£©£« 
©r/c^r-f Ji-tftotT^^r • 7V«>t- 

^a>©tH2)£ttttU ^a^^^^f-fTMS^ 
[00061 

[BRS««ftT*ft«>«O^Sl $#©«lfi£tt*til« 
fc. *589«i. a— W*. K-VSSSfcKffJU, 
^;*5*.< 7 • 7 , P$ r ?A©T"<x©ai**SfflX#3J: 5 



,) »B8¥6-1 7 581 7 

[0 0 0 7] »•&#©«* ©HJSfctttUl'iGiE-rSfcJC) 
fyj-t?47 • S'XxAfcioXaWfcSnSRWjEtBftft 

5.. 4fc, «£££©«£«. »;*jB»©S»*fc«»# 

0 [ooo 8] «jg«c«^tf. K»#ra. i a©^ h 

[0 0 0 9] tt^KB&fli&TT**. ai»anfc&ffl* 
;W*s^igna. ant- h^Jkli. B^jWSS: 

fflfi-r * * c »* * t » ^ »* « e^r 

5. -««>S->**«l»#tei:^X^ttX»*fcJ&fc. 

• ^*7-A(o«j*ai*£'J7;u:?-rAT£iE-r*. 

40 [0 0 10] bfeTit-^X. 8(riB<D:*:#93<D«EIC£-2 

«a©a8w*«kws(*Bat#*x*8trntf, a 

[00 11] 

-^Jsa^XxAS^-T. **85ffSlia!SR (CPU) 
1 OfcL >^;W (Intel) X 8 6 T'o-feylf© J 
Otl-^Jlt^X**. CPUlOtt. J'XfA'^ 
1 2fc£-?X<B©#S©«Jfc&*fcffiSt6tt3n*. * 
50 WDJJffl^^'J (ROM) 16tt ^fA-rai2 
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srt-u-ccpui otdgfcan. &*?>v*-fiKte 

fe»JWi--5S*Mll*->^ A (BIOS) SStt. 7 
• • (RAM) 14, Attt*7^ 

^18, **xm,V7*79 3 4 t>, ->Xr-A • *X 

1 2U:fflS«5W«n*. AW^r^^l 814, 

»iE«si»2 otaei-?)^3>^a-^ • J'Xta 

.-f^7i-^ (SCSI) 7*7* frf*^* 1 * 

£. AtH*S£H*>, a-* 7*79 

2 2 M*lM*<f • 3 6 &tVT s /*r 
A-/S'X». 2£ft**3n*. *-#~F2 3, h?** 
• tf-jl-3 2. *J:tf^K-*2 8B*-* 
T , 3.—*f ■ -f >^7x-X • 7* , 7* 2 2 trt-U-CV 

xVa ■ i 2ic«s»tt*na. T^xru-f • * 

-*3 8tt. ^X7W * 7^3-3 6 Ci-jtf^ 

S*t-CV»**~ >?4-*m&79?9 (MAC PA) fcg 
©*- ^*.*-l«3 3*«'^A-^l 2 RMS ^ 
fettU-C, v-f £D#>2 1 caC&flF^A*-^"? F 

*>2 7^©#>»«att£«©^X*A*W2 ,iWM t a 
*-F2 3fci-3T, 3.-lf"f> 
^ 7x -a . 7jr-792 2 T?Jfi«5*n*«lfl<fc0 

*- f-f * • *- 1* 2 3 B. 3.— If • -f 
fiBStl*, U-'7 : tt1t£<D ! t 9 • F"Cti 
IC, * • *- F 2 3 I*. 'J 7A^"f A • 7^'J * 

x-fi^JMS^D'fci'"* (» SF > 

* • *- F 2 3 e?V»TI*. «ta 7 *#JBUrWMfc 

WW*. 

[0 0 12] BZfc. f«<SW«:A©ffo^:#a©«FU^ 

rte, »«©»*«*9fcAfcMf*»** , « fflfcft* 1 
»2 ohz*>€>«*»2 oKHzi-c^-rafc^tnr 

[0 0 13] Ztitt&itRtoK* H3tt. «)£©fcil*3fc 
©-SO S->fc»LTM*l*»9«**A«>**7T» 
fct^Ltf, H3©^77©tt»*li. &2 0 0Hz 

hanftfloiooxwtfi: (rcwwt 200H < 



#0B¥6- 1 7 5 8 1 7 

Z 0)»^lKHz(0*^835(lb) IE****;* 
n, jfi[Ali2 0 OHzT^M^WSfft*^ &BtilK 

A»U wh-WMZXIzti.— tftfEtfrr**"? 
W«S*»tTV^<. TJWttAKlt 0St^©JB«»; 
-O 1 0 O X»«6»UT Witt 6»W!^I* ■ 
tt-cartO ©£«»#«#(■£*. *Efc* , *I** v t v > 

*M*fc A* 6 4 0 d 15 TEft-f* S 

»5*irv»**-&, iodb*i, m^on^.9coh-> 

(l 0 exD (BB^AfcSfi/2 o) / (l 0 
e x p OE#^ft/2 0) ) Zft.ZZblZ'SMi'Wt 

ATJi. M»*MMI»»3. 1 6fcMW* (a— 

Kic,6USL&^aK»w***SKri, c©«»c. ¥^ 
^#©A*Hif»© : Bfa^^-'i'*^t«»i:, #aw^;v 

*^©»3£©X*PliS»© 1 0 0XiE#M^fcE«^^' 
i tofcMttftK'rtHhPMJirrs* K*WSS«^" 

y^7 • S'AT-ACitftft^W • 7 7-f JUO'JT^ 
-fA«iEC«o-C, a— IfWJlf^ T ■ S/Xy A 
*-HHC««T!*. M*WSCJ:*Mae«*ttViJ:3 

[0 0 14] ^MO-^Jl^pt^-f 7 - i^X^ATTli, 
M*B*ttf»©M»lAy-yri;Ur«fflU-r, 1M©9 

[0015] fi^K-^B^efiewraT^g 1 

*«jbS. •7;u^^7 I -<7'->7.TAT?tt' 



-200- 



03/16/2005 10:18 FAI 612 339 6580 



KINNEY & LANGE P. A. 



@053 



(5) 



»*. £<«/g£ttTU*:/?>F<D'V;/ F*>/80$fc 

iE7 7"f /nMtrau ^n^»W<o-ffl^ux^«)S 
x^±<oxt:-*ta*K»««i (rhou t^±rfL 

Hout) tt, ST*t*S»^y F*>Ttt»*.fc 
V>«*H» (RMS) «B£«tt«r*iWK3nfc. £ 

COAy F*> • -fcV-frBtttt. ltetf> 

[0 0 16] B4fcfit. fr^v*^ teW*s<t^*®) 2? 

ft^L2 7kQ, 2 2 kflfcV>L3 3 kQO(B*»^) 
fittSR7*5«fctfR8£:, (0. lwF^UO. 5 jt 

4tt, LM3 3 S^xJV^^ltiRR^nTV^^O-C* 

*n*i93akRciaBi o eascttfi o 8fcfrux\ * 

***JWtlMB*ll 0 2fc*tf£?**^tt«a»l 0 
6*£tf 1 0 8B7^^fcUTl«U 

«»A**Ktf 06ttaBP«BEH»l 0 OKioTff 
JtCHJURIi* flWf^WHsensc (a? F 

jft3tt*£> Jttt«»l 0 2i3J:tfl 0 4 (DIE (0 A* K 
All 0 243£tfl 0 4 0tHA (Hsense) t>*JE» 
[0 0 17] 3 SlCfMBKMU Ay F*>&»Ei8tt* 
ttR&;^CDiMnfcft*/W7XAe*:?. B4fc«T 50 



*«B*F6- 1 7 5 8 1 7 



5 



1 0 4COPjffllW^l 2V^ftU Lfc*pT/Mr^ 
<&Ay F*>*W*StiTV^v*teil-etift«kIliT* 
*E*t*WjS (fcfc*«6V> KKMSsns^&Tfc 

©«>f (»6 0 0Q) fciot, thttWM 

<DA*]«J9E*t0. 7VaTfc#t!*tt*. l/fc^T, 
(Ay F*>###t'*££«? : fiEt'*> 0. 7V<DA 

ViDft^Of. HsenseS^ttfcStt, Ay 
F*>0«E*Wtt4n*. 

[0 0 IS] 0 5^feJ;^ISJ6^7n— ^-v— htt, *5fi 

U ^?2t. 5fcK04<&lM&KWUTjE^fcJ:5 
5/XfMth«> • • 7FUX • #<>*£i£ 

< jpt«)»i o i or Fi/^Moat. 

tmft (S/N) tt;*t7edb(3[)->AxA*ffi«LT43 
0, *#V^*tX OdbttWsS 0dbT?»^«-&, 

b^feHJe-r*. »|B(0 : &fi3 0dbtS/NH:7 6d 
b^lra^t^t> **^«ytoi o edbicte^c 
itfS)>OU«vmi!a», l20db^H40d 

Rlt;i-^*T : ffft^2 d bfO«»L«l^. 

ft* «H«««U^* 3 0 d b, KflkO 3 2 d 

b, 34db> 36db. . . , 106db (fit*:) i 

-r*. -rastot*.«k-*a <«iw> H-2dbt-r^. 
LWot» dcoflrete, 3 0dbowffl*si/^;ui 

1 0 6 dbfl)ftWl^tt*Wt a— Sf («B 
*) cott^fc^r^*a** : &SWil'd t ^3 4# 
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ifOtfS^FEIl. 5 0db-3 6db = 14db v P*S 
6 6db-3 6db = 3 OdbT**. 

Co o 1 9 j a sic *»wc», -ftitrzb 

5tJ©fr*Lp£JgW-Ctt> h-M*3#© 1*92-7 

'JxMcBttSnS ft 3 1. 25Hz#&2 

0. 1 5 9KHz STWjgfflt&a. C©| — 20 

±&a>£$\~ 2 8 a© 

*IfKl ffiro. -&»T5 6©h-» . &f»->*K 

wcssrsNnws^trt . asm 3 o#5fc» (»2 8 

ft. vX-SrAtt. ffifflfp©Afflrt«H>&©«B*ff©K 

.MiXr?:/ l 2106*, fll/^Wft^l/^^J: .30 
5 *flfcr *. *r f 7* i 2 Tfiffi*t»*T?teu fcfgjg 
Sn&«f«. Xf^6fc85, ffft^Sfc^db 

«W-«t**s U-'Vk iibXlt 

±©09TM1 1 0 6 d bfci8T-&*T?RtfSnS. 
SWRofcCiiWa-- yA*»C«fcoT*«na. I — > 
Hiftfc**tf-e*ii::*Jj6;-r*Sfirt»a-- !f • fayy-i 

ft*. 1 0 0 Xd>flO h->TfflS*»4W^. a- 

x A U T £ ©JSKSHeWPa— if fc£»T* £ £ 

y7i 3 «5*a»yo-bXT, ?lfcl*» t P©h 

->*th-> • 77-f/l'©aa©H~->T*** 1 £3* 1 

h->H»Sti*fll"VW*»c > j**a.-if • 7n7 



»B8*6- 1 7 5 8 1 7 

JO 

-7>», K»l/fc*S»ft«ffl<0*7iry HffftSr^ 

£©eQHrt©#je© H->|-5tfr2>a— tP<0B^ltWS 
*7*tv b«5Rtil£T?fcf)> £©«»ftffl 
©7n7 7^W^A£fc!&©;ta#fl$sa*±jS3ft*. 

t> . a— 9ifi 6 e d b ©#s i"-wcKfc*rs« 

fiJ8BO^Sa;Sffl^T. 3 1. 6©«8 CTfcfr 
■6. 10 exp66/20*1 0 exp 36/2 
OTSH^fcffl) lc¥*?«a— if&5gjST$«r©§a 
U^;|/£#ttT. ^©fflfciScfc*5tt*a-1f©5MjW8 

T5»7"8T, K»+©h- >»th->- 7 7-fJK0S» 

7FWX+1, TFWl-N+l) , JBfltt»7*CJ-fc7. 
ttXxy7"4K;ElCK »iU>] — >«3»0tti-r. 
[0 0 2 0] H7tt. a— if©«B^»S*1lli«-f*<fc5 
KT^T^rV 7 • 7\s4 • 77-f JH£#EiE-rSfc«)fc 
*^<0*-x-<* • *-H 2 3±tcS*5&S**fcS 

*«9 l Y*>ffl©2z>©^-03EI»At*sn-CV^. Si 

PViTW^ateattW-fS. a*#fctt, 2-pcr>|aIES2 
0 3 £2 0 3 a«lR— t^-fr* £i«4^SA»T»5 
5. * 6Ks §B2 03t203 a ©tSJfcKj&liP^cO 
^ffi#-^-C*T filler*. *J«0?V*^« 

(0 0 2 1] ±#3fc©»». ^> 19ffl*ifftfT5lK» 

8 2 0 3feiWSfl3S82 0 3 atz*tl*ft77-atr& 

r'w^^SeiftS (ADC) 2 0 7feil^2 0 7afc± 

[0 0 2 2] DV?*? 
47 ' 7*W • 77-f^2 0 1©^**^ *BS©fe** 

-xw 2 3KA^$na. COT'K'yy 
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U 

**V 2 0 5#£V2 0 5 a\ZWMt<nZ. 

77 7tLT«fflSn^ *-f^2 1 lfc<ktf2 l l a 
(DSP) 2 1 9*±tf2 1 9 a>\CDT/W • 

[0 0 2 3] jMDG^U 2 1 3££tf 2 1 3 alSRA 

»cdsp 2 1 9fcn-K^n^ia^*^*»tti" a? 

fcfc*fc*»4ft&. aiD«E»«U 21 3*5cJ;tf 2 1 3 

all, ^n7r^;W- ; r-^fflt#^^»ij>5ra)n--K 

±) ©fiRljU&UXfeJ:^. 0^*^2 0 9 45^^2 0 
9 a|±, DSPT?»31Sn**r''9 s -^«ai»T*t» 

-f^;V- -f >?7x-X (MIDI) £4£oT> <> 

[0 0 2 4] ^^;W8^D'bty1^2 1 
1 9 a -r^i^x • < >X h;W >y4fc*& 

Tf«*nT^fc*7 : A'TMS 3 2 0 C 5 1 fcJldfcSMB 

r/aizyfrtt, ^H'77^M^D77^'T- 

«3»T* ^T^^t-^W^x- * teW EK-fc^S left: 

[0 0 2 51 *SB9m* DS P(Dmft<DV}ft&Mn?Z 
1 ft<D^^JlD$tlfe*^«t'pTD S PCDBMPSfeJ 

X&&tB& (FFT) 2 2 l*3<fctf2 2 1 a, ?H • 50 



»B8¥6-1 7 5 8 1 7 

J* 

77<^2 2 3*5£tf 2 2 3 a<7>«iE«tll. fceVKiS 
7-Ux£fflSiS2 2 5fc±tf2 2 5 a#fc£. rtlS 

2 1 3 3»» DSPIC^W • 

MIC, FFT»»tt, f?f-^&, <kD«M*<B^£ 

(as) • -rfcfc-s* ffth ■ yyt^z 0 

lCWtU pt^U 2 0 3**1*2 0 3 aiwK«3nr 
* *HifcSt£ W#r-* <fe> » & £ fc K« 

10 0 2 6) > 77-f A • 7"^©FFT*4 

£5IC^~*£&I£TS (0 8$5«l:tfB9> ♦ ±«©£ 
dfc, ^ : &U2 13^7'D77-f^'7^H 3-— 
tf h->T©**#**«A/rV> 

[0 0 2 7] *l^> »|[jC0FFT«:)fiHL/. x^^iE 

x, ^lE^n^^u^f ^-^^ffl^r^^^^fc^ 

FFTW22 1, «IE«dl2 2 3, Wl^7-Ul 
*^?S»2 2 SttU TJWi'-f AT!SMB*ftS. 

m*^«iEanTv^^i§KBtti,^^ fc^L. vast 
77<M **ott^trot«i«5tS!:i:*JT«<&±5 

[0 0 2 8] yi/-f • 77^fJWr-^lt tflE^n, 

fftux b^ssvawp©^^ "7*-^^ 
«tW2 1 5 aKArtan*. ^^Af - T+utr&m 

%2 15it tfjER^-f 5?^* ' ■ 7 7<W 
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[0 0 2 9] B8*5±tfH9fck ★WHTWl'^JV 
7 ■ • 77 i)V2 0 1 *|»iEr*fc*tttJHr* 

©***awft«»t*«E'r*. H7c«u «o±b 

[0 0 3 0] Xf^/K, 7D-fcXjWWIU 7fy itf 
:/2^-tf£|»#JT*,, #lc, Zry73T, a-if 

■ 7 r n7r<;V-5 r -^^J:cXt^^RAM2 l 3#>& 
DSP 2 t 91CD-H-T^ B #c£. 7fyy4^ 7^ 

-f • 7r<;^-x-^i^bTFFTK»^fT5n. 

ittf yD7 7-f^ • f-i?l:fcT«p^»S 
K&l**ffftWnF.2tl«. fc£A.ML Wt*ft 4. 

«S#4 o d b^SSTfKfeU^oftfeoin. 

hftfcttJDffftfttt* 20db (3 0db-10db) 
CttttCJUULft) 3 1. 6€i»«*fflt&0x eico 

a— !f Otfftlc 3 1.6 ^mt^R^Jllz&^X 

ne^fcj Earra, ^»t>^^^» 

-F2 3&BM2 0 3;fe£tf2 0 3 a£®fi-r5„ 
[0 0 3 1] ^r^6T, &iE3nfch->£, a- 

<;wc»UTiffi7-yxa!^?aff^fTb, y-**? 

D A C 2 15 tCcfcoT, «IESr*©:/W • 7 7< 
dtOjftTSSTU F^n^aofclEft*;/!/^ • 77 



#08^6-1 7 5 8 1 7 

14 

[00 32] 05, 06, 08, *5<fctf0 9 K^UfcT' 
JfiU 0l©7VX£SB1ft£tB2 0&ifOD>tfzL-^ 

<&^^i«snj:5. *t>\z* *l*t)0i 

[0 0 3 3] HI 0 lis FFTSgffbfc^ 

■ 7^*a-r^:77Ti&*. 7W • 7 

74)UZ&W*b-><Z>m&frmMZimiZ7F;l, (5 0 
Hz. 2 0 0Hz* lKHz. lOKHz, 1 5 KH 
z. 2 OKHz<3j^»£0«^LTfc*) , &mtSLfk\Z 

UTfc*. *<0«3^5ftlcifc^U. ft 

a~+fe>IK#te5 0Hz, 2 0 0Hz. lKHz, 10 
KHz, 1 5KHzrWS^*^I€^tlTt^^C0 
tTZ>. Z*>\Z. Xmw&SiZ, #»W<&JEErtKttK:j; 

&nrv^ 0 01 1«, wuti^r^w • 77< 
»na»^ >> AF , ^'rct5ic. .hifio 
*«atiT^«. cottft&BKN ^a^i^rc. 

[0 0 3 4] IK^^BiHriJOIflSSLfiJlLfe 
[0 0 3 5] *«W<0§gJBS8«*^-r. 

(1) 3>tr^-^ • e/x^A(oa.-ifoKAits^^ 

(2) atmtt^y^ WSEzl— tf«Ci!»S<it)l 

t-T^, (1) JCK«Sco>5ffi. 

(3) *ft<4^1o^h->^- iffciUBS) 
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-^■fc-^-rsXr-v^t. B9E'>fc<«!:'bl'POh 
- >*»fliEa-if KM ££©3* l^Vfc*^ 

Jfc-r-5*7-fcy HRfttSStK iftEa— tf • 7a77 

(2) Ksattw^a. 

(4) WEftjET-xym ifoEa— tf • 7*D77-f ;V 

$ft< tfe ■ • 

flJE^^t:*-^ • ^rAiC^Mir-SXr-yyt. 

itf^^rSffiaftKSft-r^X^y^i. MEa— * 

RIU9XiBl,T. giEifir*©«»&^ir7V-'f -7 

(3) KEtt©***- 

(5) mw&m^vfifi- teTm^-fi* • h- 

>©j»E&3=S*^£&&T*Xxy7<!:. WE7U 

-f • vr-iM-mi&mfi**- 

UT. &jES*7V-f • 7:>"^;^£flsi^6•r*;K.7••;>7■ 
^:. Sllffia- tfi6ll7fcIitlE&lES&*7W • 7?"f;P«r 

m^r-sxxs'^is^tritfewat-r.?., (4) k 

(6) a.— tf • ■fnyyUVt&feTzm&ZTy'? 

* e 3 frz&m-r * ^f-> 7*^tf c *: s»« jt-r 

4. (5) CES»<D^ft. 

(7) 3>tfa.-^ • tfCOIB^JIcS^s 
a— if • 7*P77-fA'$:i>W£TrS^&.is ffilBa— 

xAtfS^WrtSfciETS^Rfc* HEa- tffclfeEtt 

AEa^w-^tu^ sab a.* c t t 

(8) WEfcJfc*R*», i8Ea— tj»tc:/>&<£fci-2© 
h->£l£«T*«tfcv fitlE*J>fe<£t>lo©h-> 
ASBlTEi— iffcB8tAaSS^VT**i:*, WEa 
— y^6©X*SStt®*^art. 6&Ea-1f>&©A 

rtfcattstfcsr. ME2>fc<fc | bio©h->©#* 

(9) SCC. 4>&< tt>iaoh"->«ta— tfCSJ* 
->fc-fc-7f**Rfc* ftfJE4>fc<fcfel-P©l — > 
V>T*7-t5' Hfi»»£#tfi1-$^Ki. tt»©S-> 



(9) 4$W¥6-1 7 5 8 1 7 

Jfi 

»OT**7*7 f-«»i*£tf. UtEa-lf • 7*07 
7-f £ i:*W18£**. 

(8) CEftOSa^A. 

(10) fJE£jE¥gU>i, MEa— tf • 7*077-* JW* 

< • 77'fJU&ME3> 

JO MkftK:X*t-«¥BJ:. WE3.— tf- 7'077'fM: 

UT> flEIE#*©ff«*#07'W • 77* MUM? 
*¥R£*(8**c:.t£#»£:-rs. (9) E*©->* 

T'A, 

(in «Ea«*a*^ 4tiEt*»*- ?<< * • h-> 
©grE#EiE»*««*sa-r5#a<h. isrETV-r • 7 

«iEa*7u-f • 7r-f^*^fier-5^ai. WEa- 
iffitfK:aaEtfjE8?*.7 , w • 77<;p^m*r^^» 

20 i-tWASC: (1 0) tcE**©^*^ 

A. 

(12) a— tf • 7077-f ^fcttS-rafifrE^g!)^ 
iftE^t:*-* • ->^fAi:A7 

i:3A>&Ki&T*?»£fflA*ir££4$»fcT?>, (J 
1) KEfEOS'7'rA. 

(1 3) 3>Ka.-* ■ J'XfAOi- JfSrStttUT. 
a— trtMfcbtetf^T. a-if '7P77-f;P*ftffi 
TS^Kt, IdEa— tf • 7n7 7-r;ncS-JV>T, M 
E3>tTzL-* • '>7>xAO^diS*ftiEr«¥a 
5» t. flffEa— iftME^IEW^^U^^iB^an^* 

^ • ->XT-A^g)»a^s^iE , r«ctci-3T3>tr 

(14) MEKtt^i***. flftEa— tf lt^>»: < t *> 1 ■? 
t»io<o >«*90Ea-tf dMc^aifrtt^;^* 
a-^6<0X*SSltm-5>*-?» fitlE'>&<4:fel , P 

tS. (13) tBi©3>Ka-# • 7*d^9A. 

(15) 3 6 tt. < i: t> 1 h->*ta— tf fc«i 

h->*-fe-71-*^8:i:. fiflE*'J*<i"b l^Oh- 
>*JflUEa— »f fc«J*TM c fe 1 1 <&SS U^;HcS 

t. 8lFE*'i'i<i: , £>l^«!3h->'* t a— tftaiftxHIii 

»«rs*7-fey h«gRt«r^, WEa— tf • 7"U7 
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(10) 



ftggjp6- 1 7 5 8 1 7 



17 



18 



(14) \&8&*>\Z*~9 •Vulfli*. 

(1 6) ffil62fcIE*aai, IWBa— If -7n77*OW* 

fc < <h 1> I zho*-t<( * • y W • 7 r -f JH6IMB3 

soffit— if • 

Afca^T. MB«ftiBVW7*7h«ftfcJ:^Til 
r**RtC«A*^t*1Wli:r^ (15)fcE* 10 
(l 7) im*J*ffl**«^-*K«M»*ti*J:5te: 

T. flHEHF»7l"f -774A«fM**«*ltfc. 
^^atS<B/t^c:t*<*at1-^, (l 6) fcEfceo 
[003 6J # 

«E. Sitf**©^^*^ 78lftl::aMTS5, * 
[BB<OI»#fcaftW) 

[fan *«w^«^T$^3>tfa-^ - ^rA© 

7ny^0TS*. 

[02] ¥^«^A0!>WO>c*SO©UU«*«aH^ 
[03] H2£*tec9, »20 0Hz*WlKHzT 

[04] ln^yH^^^ftt^M-r^BB^m 



[0 6] a— ^0WAI»«««*<&**K*0 , t'<Tft* 

ffttfca.— tf - ^D77^^*ff«irr*^D*^**r 

[0 7] a-if p yD7 7<^C#*£+***PWS*i* 
-FT**. 

[0 8] tf • ^D77-f/M:*9T^A* 

-fcx«rr7P^Y- ft**. 

7 • t^*- 7 7-f ^*<KE-r*fc»o^a 

[010] K^KK^ifiS^ BWfc^.— tf * 7 n 7 r< 

[011] *«Mlc«e-pTa-lfcO«*»«&*|jEbfc 
ft«)«E»***7o 7 7 "OUfc^f 0^9 7T»*. 
[flHS<0lK0JJ 

21 -r-f^Q3j>> 

2 2 a— !f--f >^7x^-7^ 
2 3 T^a-'fc-F 
2 7 H*> 
2 8 

100 *ffiaS£*mflElfil& 
R7 Jgfig 

C =3>t=>^ 

106 ^^aRC0te 
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DETAILED DESCRIPTION 

[Detailed Description of the Invention! 
[0001) ~ J 



^^m£^ Sft 1 ?'^ blVenti0n re,SteS 10 me ^ti-media system which identifies and 
a?d a useVwin iSSSSf ♦{ , ^ hermore t0 a a hearing trial will be performed to a 71 

ttzstt arsxr Next ' ° utput s m " 

impossible generally, to recognize the voice of the fixed range. Usually ^S^I^^Lm 

ZT^££?f& — — * • **** — ^ the he™! loss 

[0003) Usually, a hearing trial is given to those who wish to work in the office where noise level is hioh 

jhe^pome of the heanug aid to «be voice which received iAdjusL using " l££Z£2? ,S ' 
[Problera(s) to be Solved by the Invention) Current and multimedia computer svstem are used in 

5 nX Ttarin.^? te CaUSed " n °' is iD whether " exami,KS «™» » 

nas tne lauure ol hearing m a classroom environment especially, and studv A teacher <*>., k. .t- 

SEE? ST* "i* ^ ^ is - 0n * e *« row 1 and L tt^SS^S^^^SSi 
utd S^f^' S ^ 3 S ° ^ US6r profiIe 0311 be created > this soSeus^r profile c^ te 
Toml J?£* 1? mu,tim f*«r^entation can be compensated according to a specific Sen? T 
fo006]' multimedia effectiveness can be acquired now 

tIT ^ ?r ach f ° r f? 6 ^ 8 31,41 amendin « ** P roblera of ^ test subject's hearing are 
used. First, the hearing trial generated by the multi-media system is performed to a test ScrtlSafL 

hsek: aSate fte case of a cl ~ en — nt ' a test * • 

KI S ?f k, ? g JSf ne ? Uy ' a test sub J ect ' s ^™»ing the hearing test program which cutouts a tone to 
the left of 1 set of headphone, or a right channel (it corresponds to a left SlSTfron. v^vW 
sound volume. Although the tone outputted constitutes thewhole tone lZ> trial f££g £XZ? 

ntto://www4jpdlncipLgojp/cgj-^^ 1/9/2005 
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2 Tc , ^ V . 0,Ume reaches 1116 maximum level. Next, the test result about a specific 

^ ,f lt , C0 I mbines Wlth ^ explanation and an accompanying drawing aid Luire, 

CPU10 throu^^ e s^em°bnTl C 2 l a^ neil H °^ | various °f with a system bus 12. It com^cbwiu^ 
Xs em mlos^wh y ? £*, k' ^ d read * 0nly memory W ^contains the basic input/output 
7n^lfl t } Z h f° ntt0lS baS1C Computer abi,it y- ^om access memory (RAM) 14 an uW / 
output adapter 18, and a commumcation adapter 34 also interconnect in a S v«£m iZio I ™ . / 
output adapter 18 can be used as the small computer ys^^ 12. An input / 

„i- . * " wa F«* iivtrALra; marketed from IBM, are interconnected in a svstem hn* 1 ? an/4 

Sc^au^fvl? ^ U * ° f 1,1086 Wh0 have bearin S loss to the fixed tone of a 

^ng^lTZo^^ ??j eS pr bjeCt ° f *f of Awfati -id. to care aboS nav^ 
the tinie of. 000/ n? if 001 ? 2 lk ?" P1 L ease care abo * that it is still more specifically coiisideredat 
me tune of 100* of the value plotted on the curve that the threshold of hearingis normal (toVcases of 

J^:/Avww4.ipdl.TOip^ 1/9/2005 
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strong on v»iou S fe q l„S^Ai^7w^hf n Wh, ^' he T' S hearin8 is insnff " :ie "« « « 
graph of itaTOgJ b *o Sled Z IfSS * XS2 ^ Wh ° ^ .° ,der t0 Creatt 
which is a specific freouencv iTinnwwrf y . 55 ** tone soun<l volume < decibel <™') 

user reacts .hat the S Z ablcTSSj Itt W,ame is canfed out mtil a 

100% of sound volume at toe time ofl ce^n ft aVeM « e peraon * at ^ be heard to 

person is known until a loudness level of sound is set to sXJ mlf .v .k ( } J average 
about the tone of a eiven freouencv Th.r.f™. 50db(s), lOdb is the amount of the hearing loss 

on this anmd-TOhuS S^ThL^ SfT T ? hearing «°*«™««l<» multiplier b£ed 

divided into *etl^by ^ *! **i f tio which 

uaerlTeS ^leUnti ha^^' '° ^ "* l0U<taess level of «»■' 10 » average 

complement to making a louuneS ESSSSggEZS* heSofm^ ^ 3 
frequency. This method of judging hearine loss ZnZ^ kTT? . •■ ^ • mg of 1116 SP* 5 ^ input 
An*** and drawing . (t aTfoS * e fl ° w ch *« * 

frequencies, subsequently real-time correction of th SSfite ?£ a , ™5t ?25 J Van ° US 

^ofdra^, and , 

ioZ^T^l^rm^m^T ■? n0 ^ d,cat0f * whi <* using headphone instead of a 
outpuVed to headph^rand S2^^^v?Jt ^ 3 bl * » 

may occur in a safety aspect StaX?? *?£ Wmd P ' eSSUre IeVel ma ? become ^ «** 
is, a loudness M^^^S^^SSS^^ * S ° re ^^vely. That 

necessary to proofread ; a iZJZiTJZF* on various frequencies. For this reason, it is 

is l^hV^Zi^^^^ h *f iT^f? ^ SpCCifiC bfand 0f ^phc-ne. It 
include it as a pafof t^ ° f ^ b ™ d W-d to 

for all headphone marketed i!X^™!T^,? 1,16 mpossible to create proofreading file 

headphonVaTc^tel to SfZS™*? 0 ' hC tes [^ on which judges whether compatible 
^dLa^SZ^^^St 7 ^ indUded - TbmSm > lou d SP eaker 

offer the maim effect T^^TT^T^ LH ° Ut) WaS t0 ° ^ 811(1 was judged to 
neadphone X sXtion ovt.^ IS 31 d >^ence which cannot be treated by most 

headC wSSS fiSarT sct a of^ h r sensor circuit showi in ^^. 4 ™ s 

automaticaJIv W win detect it, it 1 set of headphone are inserted, and it reduces sound volume 

drawine 4 MoSS i, ^ ? * melS ( ,eft " hand Slde ^d right-hand side) are shown in 
voltage circuits 1 00 wim ^m^^SKi?% ? ^^'^pectively) The source reference 

http://www4Jpdl.ncipi.gojp/cgi.bin/tran_web_cgi_e^ W/2QQ5 



03/16/2005 10:21 FAX 612 339 6580 



KINNEY & LANGE P. A. 



@068 

Page 4 of 9 



ctZd ^il^ 8 ^ 1 10 3 neg3tiVe inpUl ° n ** channe l comparator 102 and the left 
channel comparator 104. Comparators 1 02 and 1 04 are marketed f model / LM339 1 Th7cha^i5 

comparator 102 and the left channel comparator 104 through number RC circuits 106 and 10x7f 
Hn-otok,, respect,vely Number RC circuits 106 and 108 of HirotofcTfunct^n as a fL aid k prevents 

ntmteTnnS ° f ***** ^ly ^ heldffio 

voltagerwS Ibv S?SS • ' ^ comparator input voltage remains exceeding reference 

^SS^a^^r 8 ^ ^ C , ,rCUit 100 ° f COmm0n >' * erefere a comparator 
cZ™^ ?? S. 3 u 8 ^ $enSe < head P hone detection), and a high level can be maintained On the 
contrary, ,f a headphone set is inserted in a detecting circuit and connected the elecu^alCential 

TZ?»\? *T f?^ " PUt ° f 102 ^ 104 falls from n^L^S^S^h the 

2S52 < Hs * nse) of comparators 102 and 104 will also follow a voltage drop, and will bL sTto a low 
Erf? fT° re> 3 K head ; hone detecti «8 circuit has a power source and tne SIpote wWch exTts in 

ttcTdown/ n'tK ' m a t^ 1 ^ ^ fonVard inpUt t0 3 «^ (^tween a pSwer 7olt and 
touch-down) In the circuit shown in drawing 4 , 12V exist between a power source and foe earth He 

vXfh b °l endS ° f COm P arators 102 «<■ '04), merefore a bias pit becomes Thisbias 
Sf IuXt° Ut t r ean V 0 d ? 6Ct Wh6n 1 S6t 0f head P hone connected to the detecting 
2 6V, H^ev' ^/f 1 ^ v< ? ltage impreSSCd t0 a com P^or is maintained by the midpoint (for 
SSStoi 0 7vThv If dph ° ne r C T,f Cted 'A he V0,ta S e of. comparator will* divided 
SLS? 7 ] - L y . ,0W ""Prance ( ab °ut 600ohms) of headphone (headphone existine and 

21 T** 3 * ,° ff C ° nditi0n at ** time >- Therefo re, ^ce the input voltage of 0 7(ft 
H^i?? ,° ne CX,St) , V 15 ,0W6r 6(it exists when headphone do not exist) vSvation^the 
15 camed out and existence of headphone is detected. 

nX toss tht" 01 5 d ?"^ g 6 is a process ste " used ° rd e' to detect a user's 
S^KSlr? b68illS "? St£P and Uie eXi$tence of headphone is exanLd as 
DoLlr , of ^WJlg.4 previously. At step 3, a trial system sets a tone file address 

EX tn? °" P 1 I" • ' 7^ ,S ^ dallZed cffec ^ely. A tone file is a list of tones ^tJSL a 
hearing tnal, and contains the tone which it is outputted by the right channel or the loft Z! f 
be put ,n order at random as mentioned above. Using a iSrwLe (h b£5 a umt lt^ , ^h Can 

sound volume (are). TIb initialization sound volume is the edge of noise leveHft dlssocto Eriv 

?a ,S v 38 sound - voJu me = sound-volume (first stage) +2db Therefore in this 

ri* a totel'on? ^1 ? leV ! J ° f S0und , which ^ he used for a trial of a user (test subject) 

3?B S?^fh h^SJJS^S^S^ 3 . Sh ° WS that 1,16 lack of sound volum e of the user in the 
SSl&S 50db-36db=14db. Similarly, sound-volume loss of the test subject in Point aT 

U ^L^nTn ' * S S inventi 1 ° 1 V d< * ibel is used as a scale at the time of asking for a frequency 
i!" ^"f u^u** desirable ^Ple of this invention, a tone is generated every 1/3 octave anrfi? 

http://www4Jpdl.ncipi.gojp/cgi-bin^an_web_cgi_ejje 1/9/2005 
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than (about 28 minutes) 30 min™ ^^ffilSS t ^ ^ * T ^ 
amount includes user reaction time and the tf™ »™ ? I , ^ S to examme each tone (this time 
various loudness levels of 0^7 (^00^ ^^^ It* ^J? Cany ° Ut ™ mCrement at 
frequency ranges a trial takest.W ^ ? ^ subject has a handicap in two or more 

shalp, and i^tS^^^^ a ^ ^ is ^ 

this in a short time. In case the ^ a 03,1 be ended rather 

very important It is because a SgS ^^STSSlSr? * Tf C S Ud * is 

time amount too much. After outputtine iLn with C0n 1 cen f atlOn Wil1 decline if a trial takes 

reaction of the test subjeci "from anTo d T S T d V0,ume ' a W» wai * the 

When it judges ^SS^^^S^^ jKi Se f? nd suitable time amount), 

time amount at step 6, it progresseT^tec 7 h1! ^ k * SUbjCCt ^ d rece,Ves m Rifled 
system progresses* ii^n^\S^]^^^J ^"Y is not received *>* a «*r, a 
When judged with so J Ivoi^iS^^f^i^ whether * is * e ma *»™™ ^vel. 
volume is carried out to sten sTa TK.T . -? P ' db ,ncrement of return and the sound 
from a test subject Tr SSac^E : P"- T faBed ^ h receives a res P°-e 
upper example' The soZV^ c ^^^±^ ™ T" 1 Petmissib,e Level > fo ' example, the 
the user input that the ^S^^SSSi^^ q " enCy ^ h by which * is sho ™» by 

not hear Thon and hi^S^^Z^?^ ^ t0 * USer P rotlle < ste P 7 >- When a test subject did 
saved at step 13 Please ca? • *h«"t tEi ru ? frequency ,n an initial loudness level of sound is 
test frequency^ T™0 ^ * «* f all with that specif* 

cannot be compensated with this inventinn »nT ? 5 n ° react,on > a multi-media system 

judges whether mm ^^S^^^^^ .*» «■* frequency range- It 

following step 7 and step 13 When ft is L lat?Th^ / ^° fthc ^ fi,e 111 a faring trial process 
consists of tte Thon frequency Sa I^J^^V P "!? e88eS l ° ^ 9 and *• «ser profile which 
(outputted to both a right and T^tlZfu! ^ I mted - Please « about ** each 
volume with Thon a " fSS ££5 J ^ utr h • ° ° n< ?, m ^ 11,011 fi,e ^ 0ne ite *> <>' *>und 
containing the ^Xw^^?* Pr ° fl,e **** C ° ntains me emulated data 
a ftdTg in a heanSgTo iSk^S^T? ^ tf* 8 Wh ° ,e ** For exam *> ,e ' ^en 
and the addition mj£2Z 2 S ^Sb for *2 ? 30 ^ multi P ,ie < is ^ 
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received by analog-to-digital converters (ADC) 207 and 207a, respectively, and is changed into a 
digitization sound signal. 

[0022] In the desirable example of this invention, the contents of the multimedia play file 201 are 
inputted into the audio card 23 for processing. This play file can consist of digital speech information of 
others which are a part of music, voice text, or multimedia presentation. Especially, by this invention, 
since it supplements with the contents taught by the teacher, the interactive voice educational program 
with the need of replying to the question of specification [ a student ] is considered. The multimedia play 
file 201 is inputted and it is stored in Memory 205 and 205a. Such memory is RAM and is used as a 
buffer for storing, before processing digital play file information. While Timers 21 1 and 21 la exist and 
adjusting loading of the play file data from the memory to the digital signal processors (DSP) 219 and 
219a, overall adjustment of speech processing is performed. In order to simplify explanation, please care 
about having shown two digital signal processors one [ at a time ] at each channel at drawing 6 . 
However, if it is this contractor, he can offer the processing facility for the channels of both right and 
left by single DSP, and can understand that the approach of this single DSP is also included in the range 
of this invention. 

[0023] The additional memory 213 and 213a is RAM. Such memory is [ the user profile data which was 
loaded by the system and obtained by the hearing trial by the system of this invention, and ] DSPs in 
order to carry out this invention. Since 1 set of instructions loaded to 2 J 9 are stored, it is used. For 
example, the additional memory 213 and 213a equipped the object for profile data, and the instruction 
with the separate load possible area, two individual memory (above) which a single memory unit is 
sufficient as, or was connected to juxtaposition, such as a chip, is sufficient as it. Reference numbers 209 
and 209a express the interface which can receive the input from the audio source of a musical 
instrument or others while outputting the voice data processed by DSP, In this invention, Interfaces 209 
and 209a can also be offered using a musical instrument digital interface (MIDI). 
[0024] The digital signal processors 219 and 219a are numerical calculation core microprocessors 
essentially like model TMS320C51 marketed from the Texas INSU torr face company. These 
microprocessors must be high speeds comparatively so that a play file can correct on real time according 
to profile data. That is, the play file data inputted into DSP must be equal to the data outputted from 
DSP. Although delay occurs and an output is in sight of a user on a display screen in a multimedia 
environment when not equal, the voice data which corresponds until fixed time amount passes can cease 
to be heard. Please care about that what kind between a video outlet and a corresponding voice output of 
delay is not accepted, either in a multimedia environment. 

[0025] This invention can be carried out by the software which controls actuation of DSP by the 
instruction added to 1 set of instructions which control the usual actuation of DSP. There are the fast- 
Fourier-transform functions (FFT) 221 and 221a, the modify feature of the play files 223 and 223a, and 
inverse Fourier transform operations 225 and 225a in the fraction offered with an instruction of these 
additions. These functions are shown in the order carried out by drawing 6 , At the time of actuation, the 
instruction from memory 213 orders so that FFT may be performed to play file data to DSP. 
Fundamentally, an FFT operation disassembles voice data into the component frequency which 
constitutes a more complicated signal, and creates Liszt of the frequency (Thon) which exists in the 
voice data of a play file. Furthermore, FFT Liszt contains the sound volume of each tone ( drawing 8 ). 
That is, FFT is contained in the play file 201 and offers Liszt of the frequency of each tone memorized 
by Memory 203 and 203a, and magnitude. Please care about that an FFT operation is essentially what 
changes the sample of a play file into frequency domain data. By this invention, other methods of 
changing play file data into a frequency component are considered. For example, it turns out that the 
approach of taking out a frequency component using a small wave (wavelet) shows a good result- This 
approach is another desirable example of this invention. 

[0026] In this invention, generation of FFT for play file data corrects data so that a user's hearing loss 
may be compensated ( drawijngJJ and drawing 9 ). As mentioned above, the profile data in memory 213 
contains the multiplication factor in each tone which has a failure in a user's hearing. Subsequently, DSP 
compensates hearing loss by fluctuating the sound volume outputted on the specific frequency in which 
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a failure exists. In other words, only an amount with the sound volume of Thon in whom hearing loss 
exists equal to the addition multiplier determined at the time of the hearing trial explained about drawing 
5 and drawing 6 above is amplified. 

[0027] Next, in order to make the first FFT reverse and to return data to a format of a normal hourly 
base, an inverse Fourier transform operation is performed to a play file. Now the corrected play data can 
be outputted, and the voice level corresponding to Thon who has a failure in a user's hearing is increased 
namely, amplified by DSP. This FFT operation 221, a modify feature 223, and the inverse Fourier 
transform operation 225 are carried out on real time. That is, alJ of these functions act on Thon from 
whom it differs in a play file at coincidence. Therefore, a user does not recognize that the voice output is 
corrected. However, a test subject can catch now a multimedia voice presentation (play file) more 
clearly. 

[0028] After play file data is corrected and is again changed into a standard digital format by FFT Liszt, 
it is inputted into digital to analog converters 215 and 215a. A digital to analog converter 215 changes a 
corrected digital play file into an analog signal, and a test subject comes to hear an analog signal through 
headphone 27 after that. 

[0029] DrawingJ and draw^ng_9 are the flow charts showing the process used in order to correct the 
multimedia play file 201 by this invention. As mentioned above, this process is carried out by software, 
and just before digital play file data is outputted to a digital to analog converter 215, it is performed. In a 
correction process, the frequency range of output data is determined and a multiplication factor is found 
from a user profile table. Next, only a suitable amount corrects the voice of each voice range under trial 
in a hearing compensation process if needed. As shown and mentioned above to drawing 7 , this process 
can act on coincidence to a channel on either side. Generally, in this process, after carrying out the direct 
scaling of the input frequency data, change into the time amount domain for an output, or each trial 
frequency range is made to carry out the band pass of the input time amount domain signal, according to 
a test subject profile table, offset or a frequency range which is different after carrying out a scaling is 
again combined for an output, or a band pass output is mixed. 

[0030] A process begins at step 1 and a user is identified at step 2. Next, user profile data and an 
instruction are loaded to DSP219 from RAM213 at step 3. Next, at step 4, an FFT operation is 
performed to play file data, and the sound volume in a specific frequency is taken out. At step 5, the 
sound volume in a specific frequency is corrected according to test subject profile data. For example, in 
the audio frequency range from 4.0kHz to 5.04kHz, a test subject should react until sound volume was 
set to 40db(s). A user's normal reaction in this Thon occurs, when sound volume is set to 10db(s) (this 
sound volume changes according to Thon's frequency). Therefore, offset or addition multiplier of this 
range serves as a value which hung 3 1 .6 (it computed before) on 20db (30db-10db), and it is decided 
based on the loudness level of sound which hung 3 1 .6 that the sound volume in this specific range of 
this specific user will be a normal user's sound volume. The frequency range where a user reacts with 
the loudness level of sound with which a test subject reacts "normally", namely, it is considered 
statistically that he is "normal" is that from which an addition multiplier becomes zero (or a 
multiplication factor is set to 1), and passes through the audio card 23 and Circuits 203 and 203a, 
without being changed. 

[003 1] At step 6, an inverse Fourier transform operation is performed to a play file including corrected 
Thon and Thon who is not corrected [ to which the user reacted normally ], and data are returned to a 
digital voice format Next, signed-off Mino play file data is changed into analog data from digital data 
by DAC215 at step 7. The hearing loss compensation process of this invention is fundamentally 
completed at this point, and the corrected play file of analog format is sent to headphone 27 from 
DAC215 (step 8). Next, a process is progressed and ended to step 9. 

[0032) Please carry out this invention described by drawing 5 , drawing 6 , drawing_8 , and the process 
shown in drawing 9 by software, and care about that it is storable on computer read possible media, such 
as disk storage 20 of drawing J . It will be understood by this contractor that a hard drive, a tape, a 
floppy disk drive, etc. are contained in disk storage 20. Furthermore, this invention can be too shown in 
drawi ng 1 , and can also be stored in RAM14 and ROM16 which were explained above. 
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[0033] DrawingjO is a graph showing audio play file data before making the correction by this 
invention, after performing FFT. Thon's frequency range in a play file is shown on an axis of ordinate 
(the frequency of 50Hz, 200Hz, 1kHz, 10kHz, 15kHz, and 20kHz is illustrated), and, specifically, the 
sound volume in each frequency is expressed with the line extended on the right from the specific 
frequency. As the die length of a line is proportional to sound volume, for example, a line becomes long, 
a loudness level of sound becomes larger. In this example, it shall be judged with a user's hearing being 
with obstacles by 50Hz, 200Hz, 1kHz, 10kHz, and 15kHz. Furthermore, the addition multiplier 
corresponding to each of these frequencies is called for by the hearing trial of this invention as 
mentioned above. Drawing U is the same graph after correcting play file data by this invention. 
Speaking still more concretely, increasing the sound volume in an above-mentioned frequency, and 
compensating a test subject's hearing loss, as reference mark"AF" shows. Following this compensation, 
as mentioned above, play file data is changed from an FFT format, and is outputted to a test subject 
through headphone. 

[0034] Although some desirable examples were shown and being explained, it will be understood that 
much modification can be added without deviating from the range of this invention. 
[0035] Hereafter, the embodiment of this invention is shown. 

(1) How to correct the voice output of computer system characterized by including the step which 
determines a user profile, the step which corrects the voice output of said computer system based on said 
user profile, and the step which provides said user with said corrected voice output based on the hearing 
of the user of computer system. 

(2) An approach given in (1) to which the step to which said decision step provides said user with at 
least one Thon, and said at least one Thon are characterized by including the step which receives the 
input from said user when it is the amount level of audible sound at said user, and the step which carries 
out the increment of said at least one sound volume of Thon until it receives the input from said user. 

(3) The step which saves said at least one Thon further with a loudness level of sound when a user hears 
at least one Thon for the first time, The step which computes an offset multiplier based on a loudness 
level of sound when said user hears said at least one Thon, An approach given in (2) characterized by 
including the step which creates said user profile containing two or more Thon range, the loudness level 
of sound to which it corresponds when a user hears said at least one Thon, and the offset multiplier 
corresponding to said two or more Thon. 

(4) The step at which said correction step stores said user profile on said computer system, The step 
which stores at least one audio play file on said computer system, The step which changes audio Thon in 
said play file into sound volume and a corresponding frequency, An approach given in (3) which adjusts 
said sound volume with said offset multiplier, and is characterized by including the step which creates 
the play file containing sound volume [ finishing / correction ] according to said user profile. 

(5) The approach of the publication by (4) to which said offer step is characterized by including the step 
which changes said corrected sound volume of corrected audio Thon, the step which stores said 
corrected audio Thon in said play file, and creates a corrected play file, and the step which outputs said 
corrected play file for [ said } users. 

(6) An approach given in (5) characterized by said step which determines a user profile containing the 
step which examines whether headphone exist in said computer system. 

(7) The system for correcting the voice output of computer system characterized by having a means to 
determine a user profile, a means to correct the voice output of said computer system based on said user 
profile, and a means to provide said user with said corrected voice output, based on the hearing of the 
user of computer system. 

(8) A system given in (7) to which a means by which said decision means provides said user with at 
least one Thon, and said at least one Thon are characterized by having a means to receive the input from 
said user when it is the amount level of audible sound at said user, and the means which carries out the 
increment of said at least one sound volume of Thon until it receives the input from said user. 

(9) A means to save said at least one Thon further with a loudness level of sound when a user hears at 
least one Tbon for the first time, A means to compute an offset multiplier based on a loudness level of 
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- when said user b- -id la. lea* one ™^ *^ A ffl £S » SuT"*" 

o store at least one audio play file on said computer ^^^^^^ a^us^s said sound 

coSnin^und volume [fining , JSjStarSffirLT. by having a means 
(1 1) The system of the publication by (10) to which said °» r "cans <™** ^ audi0 

02) SSv- in ( H ) characterized by equippmg said me^ns to determine a user profile with a 
Uis Examine wh^ 

(13) The computer program stored on the computer read P° s ^^ e ""^» computer system 
Um by coveting the voice output of ^^^^^Zicc output 
and is characterized by having a means to determine a use ^ ^ ig rovided with 
of said computer system based on said user profile, and a means by whicn saw user P 

said corrected voice output, based on a usei's hearmg. characterized by having the 

(14) A computer program given in ( 1 3) to which J^^^^^^SS said trial means 
means which carries out the increment of said at ^^ .^ fronted user to be a means by which 
thinks the input from said user to be a means to think the input ™* * * ^ at J d ^ 
said user is provided with at least one Thon when it ^^^i^oSSdXn I Z hears at 

(15) A means to save said at least one Thon further ^^^^^Xi^ loudness level of 

the offset multiplier corresponding to said two or more Thon. computer system, A 

said/users] 
study again. 
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